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SYMBOLS 

a  -  nth  coefficient  in  approximating  series 

a]  -  column  of  coefficients  a, ,  -  -   -  aN 

cm  -  constant  defined  by     C°(pn  <pm  <ft 

C  -  N  by  N  matrix  with  elements  cnm 

d  -  constant  defined  by    V    i/r     ^   dt 

dj  -  column  of  coefficients  d-^,  -  -   -  -  dN 

E  -  mean  square  error 

f.(t),   F  j(s)  -  prescribed  input 

f  (t),   F   (s)  -  output  of  system  under  test 

h(t),   H(s)  -  impulse  response,   transfer  function  of  system  under  test 

h*(t),  H*(s)  -  approximation  of  impulse  response,  Approximation  of  transfer 
function  of  system  under  test 

k  -  computer  circuit  bias  measurements 

N  -  number  of  approximating  functions 

s  -  complex  variable  of  Laplace  transform 

s  -  nth  pole  of  H*(s) 

T  -  averaging  time 

W  -  power  per  unit  bandwidth 

°<n  -  negative  real  part  of  nth  pole 

(Sn  -  distance  of  nth  pole  from  origin 

ori(t)>  ®n<£)  -  nth  approximating  function  in  ft(t),   F  *(s) 

/\  -  all  pass  function  with  poles  of  the  nth  orthonormal  function 

o-  -  standard  deviation 

7^  -  variable,  of  integration,   argument  of  correlation  function 

%^\  $n(S)  ~  nth  approximating  function  in  h*(t),  H*(s) 

V'-fc)  -  auto-correlation  function  of  f^(t) 

yijt)  -  cross-correlation  function  of  f^(t)  and  fQ(t) 
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SYSTEM  APPROXIMATION  USING 
ORTHONORMAL  FUNCTIONS 

INTRODUCTION 

Experimental  determination  of  the  dynamic  characteristics  of  a  linear 
system  is  often  desirable  both  in  the  analysis  and  the  design  of  control  systems. 
The  classical  method  of  measuring  a  linear  system  transfer  function  is  to  ob- 
serve system  response  to  an  artificial  disturbance,   such  as  a  sinusoidal  or  step 
input.    A  more  general  and  often  more  practical  approach  is  made  possible 
through  the  use  of  statistical  methods,  which  make  use  of  random  inputs.    Through 
the  use  of  such  inputs  actual  operating  records  may  be  used  in  determining 
transfer  functions . 

The  purpose  of  this  study  is  to  investigate  one  statistical  method  of 
measuring  linear  system  transfer  functions.    Based  on  minimization  of  the  mean 
square  error,  a  finite  series  will  be  chosen  to  approximate  the  system  transfer 
function.     The  terms  of  this  series  will  be  a  set  of  orthonormal  functions,   the 
coefficients  of  which  are  determined  by  statistical  methods.    However,  no  direct 
computation  of  correlation  functions  is  necessary. 

No  attempt  will  be  made  in  this  work  to  determine  the  characteristics  of 
any  particular  unknown  system,  since  this  is  only  intended  to  be  a  feasibility 
study  of  the  proposed  method.     Two  known  second  order  systems  will  be  investi- 
gated, by  approximating  their  transfer  functions  with  a  set  of  four  orthonormal 
functions. 


In  order  to  simplify  the  mathematics  and  mechanization,  a  white  noise 
source  is  used  as  input,  although  the  method  would  work  equally  well  for  any 
other  statistically  describable  input  with  suitable  generalization. 

THEORY 

The  choice  of  an  error  measure  in  forming  the  series  representation  is 
basic  to  the  method  used,,     Throughout  this  study  minimization  of  the  mean  square 
error  will  be  the  criterion,    Other  error  measures,   such  as  magnitude  of  error, 
are  possible  and  may  in  some  instances  be  preferable,  but  the  mean  square  error 
approach  allows  a  convenient  mathematical  description  of  the  problem,, 

Before  proceeding  with  the  theoretical  development,  certain  statistical 
measures  must  be  defined.    In  a  stationary  random  signal  the  time  dependent 
signal  itself  cannot  be  defined,  but  a  statistical  measure  known  as  its  auto- 
correlation function  can.     The  auto-correlation  function  is,  mathematically, 

T 

~t,(T-)-=  L,m   r\i,mi,(t^)dt  -  avq  iit)  i(t  +  r)  m 

o 

Two  distinct  signals  may  be  correlated  using  the  same  technique.     This 
defines  the  cross-correlation  function  between  the  two  signals  to  be 

T 

^(T)^  Lim4=\{,(t)  kit  tt)  di  =   avq    f,(t)  k(t+T)  ^ 

The  transfer  function  of  a  system,   or  equivalently  its  weighting  function, 
may  be  found,  having  only  the  above  statistical  descriptions  of  its  input  and  out- 
put.    This  is  shown  in  the  following  development,   as  outlined  in  Ref.  1.    An 
alternate  method  is  shown  in  Ref.   2, 

Let  f^(t)  be  the  input  and  fQ(t)  be  the  output  of  a  linear  system  with  weighting 


function  h(x), 
then 


p  +  CO 

^Lt)  ~   )  h(*)  fitt-x)    dx 


(3) 


and 


~tioCT)  =    awg  hit)  &(t+T)    =  avj  iUt-lr)  fQ[t) 


(i) 


Substituting  for  f  (t) 


Changing  the  order  of  integration 


-wo 

"^cr) s  \  h(yj  dx    avcj  idt-t)  hit-*) 


-CO 

But,   by  definition 


"VW?--*)  =  avcj  h(t-T)  fc(t-*) 


Therefore 


VToCr)-\  /)0c)  VkLT-X)  dx 


(5) 


Solution  of  the  convolution  integral  of  Eq.  5  is  simplified  if  the  input  signal 
is  white  noise,  meaning  the  signal  has  constant  power  per  unit  bandwidth  (W).    In 
this  case  the  auto-correlation  function  is  an  impulse  of  strength  VV  at   7"=  0' 
Solution  of  Eq.  5  is  then  simply 

Tio(T)  »  W   hit)  or  h(T)  ~CV    %<*)  (6) 


Thus,  with  a  white  noise  input  the  system  weighting  function  is  directly  proportional 
to  the  cross  correlation  function,  the  constant  of  proportionality  being  the  recipro- 
cal of  input  power  per  unit  bandwidth.    The  procedure  is  therefore  reduced  to 
determining  cross-correlation  between  input  and  output  signals  of  the  system 
under  test 

Before  explaining  the  proposed  method  of  accomplishing  this  determination, 
it  might  be  well  to  mention  some  of  the  more  widely  used  techniques  available. 
Correlation  functions  may  be  calculated  directly  from  the  definition.     This  involves 
multiplication,  summation  and  averaging  over  a  reasonably  long  period  of  time, 
one  of  the  multiplicands  being  delayed  a  certain  time,  7~  .     The  MIT  electronic 
correlator  mechanizes  the  above  procedure,  calculating  the  correlation  function 
at  discrete  values  of  the  argument  ?"(Ref.  3),    Either  an  analog  or  a  digital 
computer  may  be  used  in  the  calculations,  although  a  digital  computer  is  normally 
preferred  because  of  the  ease  in  programming  a  delay  in  a  multiplicand. 

Some  thought  on  the  methods  above  shows  an  inherent  disadvantage.     Be- 
cause discrete  values  of  the  argument  7*  must  be  used  in  calculating  correlation 
functions,   a  continuous  curve  is  not  obtainable;  and  hence  no  functional  description 
of  the  correlation  functions  is  obtained  by  these  methods. 

The  method  considered  in  this  study  is  intended  to  overcome  these  limi- 
tations.   An  entirely  different  approach  is  used,  in  which  an  attempt  is  made  to 
obtain  a  series  representation  of  the  entire  correlation  function  over  all  values 
of    T"  rather  than  obtain  specific  values  for  discrete   T  •     Thus  the  correlation 
function  is  defined  functionally  for  any   f   with  arbitrarily  small  error  depending 
upon  the  goodness  of  the  approximating  series.     The  measure  of  approximation 


error  using  this  method  will  not  be  in  the  number  of    7"  values  computed,  but 
rather  in  how  well  the  series  approximates  the  true  correlation  function. 

It  was  shown  above  that  the  desired  system  weighting  function  is  directly 
proportional  to  the  cross  correlation  between  input  and  output  when  the  input  is 
white  noise.     The  cross-correlation  function  will  be  approximated  by 


and,  from  Eq.  6, 

hlt)=  hit)  =^  21  a„%it)  w 


n=t 


The  frequency  expression  equivalent  to  Eq.   8  provides  an  approximation  of  the 
system  transfer  function. 

In  the  above  equations    <|n(<o    are  approximating  functions  and  a    are  the 
coefficients  of  these  functions.     The  choice  of  approximating  functions  is  obviously 
of  primary  importance,  and  should  be  based  on  what  knowledge  of  system  behavior 
is  available.     A  judicious  choice  of  <£„&>  will  reduce  the  number  of  series  terms 
required  for  a  certain  accuracy.    No  attempt  will  be  made  to  set  up  rules  or 
techniques  for  such  a  choice,  since  this  study  deals  with  method  feasibility  after 
a  proper  choice  of  ^is)  has  been  made.     A  discussion  of  the  factors  involved  in 
choosing"  $£)  may  be  found  in  Ref,  4.    A  greater  number  of  approximating  functions 
will  of  course  make  possible  a  greater  accuracy,   the  number  being  limited  by  the 
complexity  allowed. 


Having  decided  upon  a  set  of  approximating  functions,  the  coefficient  of 
each  can  be  found  on  the  basis  of  minimum  mean  square  error.     This  mean 
square  error  is 

£  =  ([^-  ifCa)fdt  =  (lrco(t)  -tan  ^(t)f  dt  <10> 


Expanding 


£>  ft^J  <*-*£<**  ffifl tktodt  +  t-  £  W*  (fe*) Vj*)  dt 


For  simplification,  define 


6*={\(tmi)dt       and        c^^(t)¥U)dt  (") 


Substituting 


r    r00   *  v  w  " 

t  *  I  "%>  ft)  dt  -  2.  H  andn  +  21  21  a„o™  cnm  (12) 

J0  K)=|  H*l        TIM  ^ 

To  minimize  the  above  with  respect  to  a~,  set 

^=0  =  o^dn  +  z£fim^  n-1,2, n  (13) 


or, 


n  "  ^-  ^w,  Qm  n»i,2., m  (14) 


This  is  a  set  of  N  linear  equations: 

disC,(al  +  CIJLQa,+  ----  +  clllaM 

i 
i 
i 
i 


(15) 


In  matrix  notation 

d]=CaJ  or  ai  =  Cdi  <16) 

It  has  been  shown  (Ref.  4)  that  the  minimum  so  obtained  is  unique  and  is  the 
system  minimum,  provided  both  the  <|>cs)    and  Eqs.   15  are  linearly  independent. 
If  the  approximating  functions  are  chosen  to  be  orthonormal,   that  is 


a 


-  0  n*m 

the  square  matrix  "C  is  the  identity  matrix,  and, 


(17) 


a*  =  dn  =  \  lfe(t)  %U)    it  (18) 

The  mean  square  error  is  then 

E    -  (Vft)  dt   -  L  a„  («) 

>mn      JQ  n-t 

This  error  is  due  solely  to  the  finite  series  approximation  and  will  always  be 
present  when  using  this  method. 

Eq.  18  is  the  theoretical  basis  for  analog  computer  determination  of  the 
finite  series  coefficients.    Substituting  in  tins  equation  the  expression  for  the 
cross-correlation  function  from  Eq.  4  yields 

U(t-r>itt)fi,(ii  61  dt  <20> 

Note  mat  T  is  not  permitted  to  approach  infinity  in  the  above  equation.  For  the 
remainder  of  this  development  a  finite  averaging  time  will  be  assumed.  Inter- 
changing the  order  of  integration, 


Qn  =  f\  t(ti  [  {  fiCt^i  %U)  eft]  dt 


Let   0n<t)  represent  the  output  of  a  linear  system  with  impulse  response     Vrj(t) 
and  input  f .,  then, 

Qn  *°  T  ^  i^  0n(O  dt  (21) 


in  which 


(22) 


Eq„  21  can  be  mechanized  as  shown  in  Fig.   1,   a  white  noise  source  being 
used.     The  figure  shows  the  method  of  obtaining  one  coefficient;  others  could  be 
obtained  in  the  same  manner.     Since  all  series  coefficients  can  be  determined  by 
the  computer  mechanization,  and  since  the  <$>&>  have  been  chosen,  no  additional 
mathematical  development  is  necessary  in  determining  the  finite  series. 


£(t> 


H«> 


&n.itl 


kit) 


FIGURE  I 
Measurement  of  Orthonormal  Function  Coefficients 


Although  the  above  analysis  has  been  restricted  to  the  time  domain,  the 
results  are  available  in  the  frequency  domain  as  well.    By  Eq*  9,  using  the 
same  a^  found  above  to  multiply  (])  lS>    ,   an  approximation  to  the  system  transfer 
function  is  immediately  available. 

After  the  coefficients  have  been  determined,  each  of  the  orthonormal 
approximating  functions  of  the  computer  circuit  can  be  multiplied  by  its  proper 
coefficient,   and  thus  the  system  under  test  can  be  simulated.     That  is,   an  impulse 
can  be  applied  to  the  set  of  approximating  functions,   their  outputs  summed  and 
plotted  to  form  a  graphical  representation  of  the  approximate  system  weighting 
function.     This  procedure  is  illustrated  in  Fig.  2. 


FIGURE  2 
Simulation  of  H  *  (s) 
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ORTHONORMAL  FUNCTIONS 
As  orthonormal  functions  greatly  simplify  coefficient  determination,  it 
would  be  desirable  to  have  some  means  of  obtaining  a  set  of  these  functions  that 
would  not  only  permit  a  wide  selection  of  approximating  functions  but  also  be 
amenable  to  simulation  by  analog  equipment. 

By  using  the  theory  of  residues,  Ref.   3  develops  a  set  of  orthonormal 
functions  that  meet  these  requirements.     Starting  with  a  set  of  linearly  inde- 
pendent transfer  functions,  <|><^)  ,  it  is  possible  to  obtain  a  set  of  functions, 
<^(S)      ,   such  that,  in  addition  to  orthonormality, 


1         I 

I         \  

$n(s>  =  *nC$«>  £fe\  C^> ^  ) 


(23) 


If  the  linearly  independent  functions,  <£n(M  ,   have  real  poles  at  sn  =  -  C{  n» 
and  complex  poles  at 


Wi  = "  ^  ± i ^-v* 


the  orthonormal  functions  become 


*0  '   N«-|         S  +  an 


for  real  roots,  and 


^■V?  s?&S+K     ,^  =  A^5V2gs^  (24) 


11 


for  complex  roots,  where 


(S4&-...0 


cs-s^.,) 


(25) 


Ref.    3    also  shows  that  the  analog  circuitry  necessary  to  realize  these  functions 


is 


4~ 
-11 


-An,. 
An-i 


2.-£Cn    An., 


iois]   Fiji) 


FIGURE  3 
Orthonormal  Function  Mechanization 


ERRORS 
The  discussion  up  to  this  point  has  assumed  ideal  components.    It  would 
be  relevant  at  this  point  to  consider  some  of  the  errors  and  equipment  limitations 
that  would  be  present  when  the  system  is  mechanized  and  relatively  short 
averaging  times  are  used.     The  errors  may  be  divided  into  three  groups:    those 


12 


due  to  biases  in  the  electronic  components,  those  due  to  the  non-linearities  of 
the  servo  multipliers,  and  those  due  to  the  use  of  finite  averaging  times. 
Static  Error  Analysis 

In  order  to  study  the  effect  of  biases,  the  circuit  shown  below  in  Fig.  4  will 
be  used. 


''    )St 


T 


FIGURE  4 
Schematic  Showing  Assumed  Static  Errors 


Here  k    may  be  thought  of  as  an  essentially  constant  bias  on  the  input,  fj ;  kg 
and  k„  as  constant  biases  in  the  circuitry  making  up  H(s)  and  ^^'A  ,   re- 
spectively;  and  k4,   a  constant,   as  the  combined  effect  of  servo  multiplier  static 
error  and  bias  in  the  integrator  following  the  multiplier.    It  should  be  noted  that 
H(o)    and  ^(o)   are  the  DC  responses  of  H(s)  and  <§,p)    ,  respectively. 
Then  the  output  of  the  multiplier  would  be 
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If  a*  is  now  defined  as  the  coefficient  computed  by  the  circuit  in  Fig.  4,  the 
error  in  a*  may  be  evaluated  by  noting  that 


and 


so 


If  T  is  large  enough,  the  finite  time  average  values  of  the  random  functions     Q^ 
and  £    will  be  essentially  zero,  which  gives 

Qt-a„  =  f  V  K  H(P)  $^(0  +  k,h3  Hto>  +^^4^+^]  Jt  (27) 

o 

But  the  average  value  of  a  constant  is  the  constant  itself,  so  that 

oT-  an  =  K  Hio  $nCo>  +  k, k, H(o>  4  k,  ^  §ja  +\ W3  v  i^4  (28) 

The  mechanization  of  orthonormal  functions  previously  described  gave  two 
types  of  functions,  a  constant  divided  by  a  quadratic  in  s,  and  a  constant  multi- 
plying s  divided  by  a  quadratic  in  s.    For  the  latter  case,   the  DC  response  is 
zero,  or    (|  (o)  =  o     .  and 
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%-Q*  ~  K  K  Hie*  +  hi  k3  +  ki  (29) 

Further  application  of  these  results  will  depend  upon  the  hardware  being 
used.    k2,  k  ,  and  k,  may  be  measured  more  or  less  directly,  and    k,=  ^\  4tck 
With  a  properly  adjusted  noise  source,  k^  should  be  of  the  same  order  of  magnitude 
as  k2  and  kg;  the  use  of  good  servo  multipliers  should  assure  that  k.  would  be  of  the 
same  order  of  magnitude  as  the  other  perturbation  voltages.     Thus  if  second  order 
effects  are  neglected,   Eq„  28  becomes 

at-Q,  -  K  (30> 

Servo  Multiplier  Limitations 

The  preceding  analysis  treated  errors  that  were  electronic  in  origin,  the 
next  source  of  error  to  be  considered  is  the  servo  multiplier.    As  used  in  system 
approximation,  f    is  used  to  drive  the  shaft,  which  positions  a  potentiometer  arm, 
and    0n      is  fed  into  the  potentiometer  winding. 

While  the  multiplicand  will  be  reproduced  on  the  potentiometer  without  time 
delay,  the  multiplier,  on  the  other  hand,  may  be  subject  to  both  a  time  delay  and 
a  dynamic  position  error  due  to  the  inertia  of  the  servo  and  the  finite  torque 
available  from  the  motor  windings. 

The  servo  specifications  are  usually  given  in  the  form  of  a  limiting  position 

9 

(volts),   a  limiting  velocity  (volts/sec),   and  a  limiting  acceleration  (volts/sec"). 
If  T  is  the  applied  torque,  0o       the  output  displacement  angle,  I  the  inertia  of  the 
mechanism,  and  f  the  viscous  friction, 
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T=igL  +  f  gl  <31) 


But  the  specifications  are  in  the  form 


T rrwr  /   U.    \  _         I  «r 


so  it  is  possible  to  be  within  the  specified  velocity  and  acceleration  limits  and 
still  exceed  the  servo  motor's  capabilities  because  the  combined  torque  require- 
ments are  greater  than  T 

&  max 

If  the  input  to  the  servo  shaft  is  a  sine  wave  of  known  magnitude  and 
frequency,   it  is  fairly  easy  to  determine  whether  or  not  the  input  is  beyond  the 
capabilities  of  the  servo.    If  the  input  is  more  complex,  however,  the  only  infor- 
mation available  may  be  an  estimate  of  the  bandwidth  of  the  input  signal  and  the 
power  per  unit  bandwidth  of  the  input  signal. 

If  the  effect  of  the  drifts  and  biases  throughout  the  circuitry  is  to  be  kept 
to  a  minimum,   the  signal  level  should  be  kept  as  high  as  possible.     A  calculation 
of  the  maximum  allowable  signal  can  be  made  if  an  estimate  of  the  filtering 
properties  of  the  system  between  the  input  and  the  servo  shaft  is  available. 
Thus  if  H*(s)  is  the  estimated  approximation  of  H(s),   and  W(uo)  is  the  noise  power 
per  unit  bandwidth,   the  square  of  the  standard  deviation  of  f    in  terms  of  position, 
velocity,   and  acceleration  may  be  found  from 


Gp    ~  2Jr 


\W(<*a|Hc»>|   eta 

-co 


(32) 


16 


<X    -  Ztt  \  W(urt  lHcio)i  cu     duo    ,       and 

.-♦GO 

Go.    ~  Tfx  \  W(u;)|H(iJ0)l    U)      (k)  ,  respectively. 

-co 

Quite  often  the  assumption  that 

W(u))=W      W     -Loc<u)  <  u)c 
-  0       elsewhere 
may  be  made  without  greatly  harming  the  accuracy  of  the  calculations,  and 
thus  the  integrals  above  become 


°V    =  Zt\  J    ,Huj)I    ^     ^  (33) 


-u*. 


which  may  be  evaluated  by  numerical  methods  to  give  these  deviations  as  a 
function  of  Lk\_  and  W,   the  noise  power  per  unit  bandwidth.    If  the  variances 
obtained  are  multiplied  by  four  and  set  equal  to  the  respective  servo  limits,  values 
of  0\  and  W  will  be  found  which,  for  Gaussian  distributions,  will  saturate  the 
servo  less  than  .  006%  of  the  time,  thereby  eliminating  a  potential  source  of  inaccu- 
racy o 
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Effect  of  Finite  Averaging  Times 

As  the  voltage  to  be  averaged  in  the  mechanization  of  this  method  of  system 
analysis  is  the  product  of  two  essentially  random  functions,   the  product  is  random 
itself,   and  a  statistical  description  is  the  best  that  could  be  expected.    It  can  be 
shown  that  the  expected  deviation  is  given  by 

QL  _   /.5T  (34) 

of  T 

where  T    is  the  time  constant  of  the  approximating  function,   and  T  is  the  averaging 
time  in  seconds. 

The  maximum  averaging  time  allowable  is  a  function  of  the  multiplier  out- 
put level  and  the  saturating  voltage  of  the  integrator  used  in  the  averaging.    To 
minimize  the  effects  of  the  biases  previously  examined,   the  signal  level  should 
be  as  high  as  the  servo  multiplier  limitations  will  permit.    Since  it  can  be 
assumed  that  the  errors  due  to  finite  averaging  times  are  random,   large  equiva- 
lent averaging  times  may  be  attained  by  summing  the  voltages  and  times  for  many 
short  runs. 

COMPUTER  MEASUREMENTS 
Computer  work  connected  with  this  study  was  undertaken  for  the  purpose  of: 

1.  Verifying  the  analytical  development. 

2.  Investigating  difficulties  which  may  be  encountered  in  the  application  of 
the  theory. 

3o    Verifying  the  error  analysis. 

4.    Reaching  a  conclusion  as  to  the  feasibility  of  the  proposed  method  of 
measuring  system  transfer  functions. 
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The  computer  laboratory  work  may  be  divided  into  four  main  efforts: 

1.  Setting  up  and  calibrating  the  noise  source. 

2.  Mechanizing  the  orthonormal  approximating  filters. 

3.  Mechanizing  the  systems  to  be  studied  and  obtaining  the  required  co- 
efficients o 

4„     Simulating  the  systems  under  study  with  the  approximating  filters. 

Computer  equipment  available  included  two  drift  stabilized  16  amplifier 
Michigan  analog  computers  and  one  portable  20  amplifier  Michigan  analog 
computer. 
Noise  Source 

Because  it  greatly  simplifies  computation,  white  noise  was  used  throughout 
as  the  input  for  the  analog  computer  simulation.     White  noise  may  be  defined  as 
a  signal  with  constant  power  per  unit  bandwidth  (W)  over  all  frequencies.     Physical 
limitations  require  that  a  real  white  noise  source  be  limited  in  bandwidth.     The 
assumption  is  made  that  as  long  as  the  power  per  unit  bandwidth  is  constant  over 
considerably  more  than  the  frequency  range  of  interest  in  a  particular  problem, 
then  the  noise  may  be  considered  white  for  that  problem. 

In  the  computer  work  for  this  study,  systems  under  test  were  used  which 
had  cut  off  frequencies  near  one  cycle  per  second.     With  this  in  mind  it  was 
considered  sufficient  to  supply  a  noise  source  with  an  upper  cut  off  frequency  of 
approximately  3  cycles  per  second. 

The  General  Radio  noise  generator  used  procudes  Gaussian  white  noise 
over  a  frequency  range  from  30  cycles  per  second  to  20,  000  cycles  per  second. 
In  order  to  obtain  the  desired  input  frequencies,   the  noise  generator  output  was 
put  through  a  gating  and  filter  network,  mechanized  on  a  Michigan  20  amplifier 
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FIGURE   5 
Noise  Filtering  Circuit' 
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computer.    As  shown  in  Fig.  5  the  noise  was  first  gated  at  approximately  200 
cycles  per  second,   which  by  sampling  theory  introduces  beat  frequencies  in  the 
lower  end  of  the  frequency  spectrum.     This  gated  signal  was  then  sent  through 
a  high  pass  filter  with  a  lower  cut  off  frequency  of  .  02  radians  per  second,  which 
removed  the  DC  bias  caused  by  gating.     Finally  a  third  order  Butterworth  low 
pass  filter  with  a  cut  off  frequency  of  20  radians  per  second  attenuated  the  higher 
frequency  power.     The  resulting  noise  source  was  essentially  of  constant  power 
per  unit  bandwidth  over  the  frequency  range  which  was  used. 

Under  the  assumption  that  the  power  per  unit  bandwidth  was  constant,   its 
value  was  measured  as  shown  schematically  in  Fig.   G.     The  procedure  was  to 
obtain  the  total  power  output  of  the  low  pass  filter  shown,  by  squaring  and 
averaging  its  output.     This  total  power  may  be  equated  to  the  power  per  unit 
bandwidth  (W)  at  a  certain  frequency,   multiplied  by  the  filter  gain  squared 
at  that  frequency,   and  integrated  over  all  frequencies.     Since  the  power  per  unit 
bandwidth  is  assumed  constant,   the  total  power  integral  may  be  written  as 
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FIGURE  6 
Noise  Power  Per  Unit  Bandwidth  Measurement 
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Equating  the  total  power  as  measured  in  Fig.  6  to  the  total  power  from 
Eq.   35; 

77^=^DHS-(-?)}]=W  (36) 

-co 

Because  a  significant  time  variation  in  noise  source  voltage  was  noticed,   a  power 
measurement  was  made  with  each  averaging  run  throughout  this  study. 
Approximating  -Functions 

A  set  of  four  second  order  orthonormal  approximating  functions  was 
mechanized  as  shown  in  Fig.  7.    The  four  functions  were: 


(37) 


in  which 


d,-.4,^»l     -    a3=.S,^-l 


The  weighting  function  of  each  of  the  above  was  obtained  by  supplying  an 
impulse  to  the  system.    These  weighting  functions  are  plotted  in  Figs.  8  and  9. 
A  schematic  representation  of  how  these  functions  were  used  is  shown  in  Fig.   10. 
Note  that  in  measuring  a  system  function  in  accordance  with  the  theoretical 
development,   it  is  intended  to  have  the  system  output  on  the  shaft  of  the  servo 
multipliers „    However,  it  was  desirable  here  to  first  verify  the  orthonormality 
of  the  approximating  functions,   and  in  so  doing  obtain  a  feeling  for  the  expected 
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accuracy  of  the  procedure.     This  simply  involved  using  the  output  of  one  of  the 
orthonormal  filters  to  drive  the  servo  shaft,  i.e.    hH)  -  ^  ft)     ,   and  putting  all 
four  filters  on  the  servo  potentiometers.     Eqs.   17  and  18  show  that  the  coef- 
ficient of  the  function  fed  to  the  shaft,  multiplied  by  itself,  integrated,  and 
averaged,  should  be  the  noise  per  unit  bandwidth,  W.    Eqs.   17  and  18  show  that  the 
other  three  coefficients  should  be  zero.     Averaging  times  of  1000  seconds  were 
used  in  these  runs,   and  the  results,  normalized  with  respect  to  VV,   are  tabulated 
in  Table  I.    For  the  case  where  the  output  of  |),   (s)  is  on  the  shaft,  Fig.   11  is  a 
plot  of  error  in  experimental  results  against  time,  showing  error  as  a  percentage 


of  a., 


Table  I. 
Experimental  Coefficients  for  Orthonormal  Check  of 
Approximating  Functions 


Functions  Replacing  H(s) 

$,<*> 

$aC%) 

£acs> 

&<&> 

al 

.985 

.005 

.029 

.007 

a2 

.003 

.962 

,023 

.070 

a3 

.019 

.148 

.922 

.008 

a4 

.028 

.009 

.008 

.984 

Static  error  measurements  were  read  as 


kx=  .16  Volts  ,    k,,=  .15  Volts  J    fca»  .15  Volts     <    t^  =  £.*l6~*  Volts  . 

Using  these  static  errors  in  Eq.  29,  and  an  averaging  time  of  1000  seconds  in 
Eq.  34,  a  predicted  error  of  5%  was  obtained.  The  results  of  Table  I  seem  to 
conform  fairly  well  to  this  predicted  error. 
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Systems  Under  Study 

Since  this  work  is  limited  to  a  feasibility  study,  no  unknown  system  was 
investigated.    Rather  two  known  systems  were  used  for  H(s),   so  that  the  quality 
of  the  approximation  could  be  checked.     The  systems  were 


H,CS)=  sa/sV.5-        J  H,(5)=  S*+"s  +  .5 


(38) 


Note  that  the  poles  of  these  systems  are,  in  s-plane  representation,  at 
-.  5  +■  j.  5,   as  compared  to  -.4+  j„  92  and  -.  8  +  j.  6  for  the  approximating  functionSo 
Because  the  approximating  functions  have  no  poles  coincident  with  the  systems 
under  study,  and  a  finite  number  of  approximating  functions  are  being  used,   there 
must  be  some  error  in  the  approximations.     The  object  was  to  find  the  set  of  co- 
efficients which  gave  the  least  mean  square  error  approximation  to  each  of  the 
systemSo 

The  desired  coefficients  were  found  analytically  by  the  method  of  residues. 

Evaluation  of  the  residues  resulted  in  columns  one  and  three  of  Table  II.     Columns 

two  and  four  of  this  table  contain  the  coefficients  found  experimentally  using  the 

circuit  shown  schematically  in  Fig.  10. 

Table  II. 
Calculated  and  Experimental  Coefficients  for  Hf  (s)  and  H|(s) 


Hx(s) 

H2(s) 

al 

Calculated 

Experimental 

Calculated 

Experimental 

-.145 

-.137 

.971 

1,0 

a2 

,521 

.568 

-.228 

-   .209 

a3 

-o092 

-.016 

-.182 

-   0158 

a4 

-.456 

-.476 

-,660 

-   ,584 
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After  the  coefficients  were  determined,   the  original  systems  were  simulated 
by  the  approximating  filters,  weighted  properly.     Figs.  12  and  13  show  the 
weighting  functions  of  the  linear  second  order  systems,  the  simulated  weighting 
functions  using  analytically  determined  coefficients,   and  the  simulated  weighting 
functions  using  experimentally  determined  coefficients .    Note  that  the  most  serious 
error  in  both  cases  was  caused  by  the  poor  correspondence  between  the  approxi- 
mating filters  and  the  systems  being  studied.    A  greater  number  of  approximating 
functions,  or  adjustment  of  the  poles  of  these  functions,  would  reduce  this  error. 
The  error  due  to  finite  averaging  times  and  component  inaccuracies  was  compara- 
tively small,  that  is,  the  calculated  and  experimental  approximations  are  fairly 
close  to  each  other. 
Limitations 

The  computer  work  brought  out  some  serious  limitations  on  this  method  of 
measuring  system  transfer  functions. 

lo    Electronic  error  considerations  showed  the  necessity  of  using  only  drift 
stabilized  amplifiers  both  in  the  approximating  filter  circuit  and  as 
averaging  integrators. 
2.    The  most  severe  limitation  was  imposed  by  the  servo  multiplier.     The 
cut  off  frequency  of  the  system  under  test  had  to  be  kept  at  approximately 
five  cycles  per  second  or  less  in  order  not  to  exceed  servo  velocity 
limitation.     The  velocity  limitation  also  dictated  that  the  filtered  noise 
source  be  limited  to  a  fairly  narrow  bandwidth.    A  twenty  radian  per 
second  bandwidth  was  used  successfully  in  this  work.  A  two  hundred 
radian  per  second  bandwidth  was  tried  but  was  found  to  cause  servo 


26 


overload  by  exceeding  the  velocity  power  limit.     Because  the  systems 
were  limited  to  low  cut  off  frequencies,   long  averaging  times  were 
required. 
3.     The  question  of  pole  optimization  in  choosing  approximating  functions 
was  not  considered  in  this  study.     It  should  be  noted  that  with  the 
arbitrary  choice  of  poles  made  here,   the  approximation  is  of  little 
real  use.    For  accurate  approximation  a  better  choice  of  pole  locations, 
coupled  with  an  increase  in  the  number  of  the  approximating  functions, 
is  necessary. 

CONCLUSIONS 

The  proposed  method  of  measuring  system  transfer  functions  was  found  to 
be  feasible  within  limits,     In  order  to  make  accurate  measurements  on  an  actual 
unknown  system,   the  electronic  equipment  available  must  include  drift  stabilized 
amplifiers  and  electronic  multipliers  capable  of  handling  multiple  inputs.     The 
number  of  amplifiers  required  is  dependent  upon  the  knowledge  available  on  the 
system  under  study  and  its  complexity.     Some  knowledge  of  the  system  is  definitely 
desirable,. 

Once  the  coefficients  have  been  determined,   the  system  under  study  is  easily 
simulated  by  the  approximating  network.     In  this  manner  an  electronic  approxi- 
mation to  the  system  under  study  is  immediately  available  as  a  component  in  an 
electronic  circuit. 

Although  the  theory  holds  equally  well  for  an  arbitrary  input  and  for  general 
approximating  functions,  this  study  has  been  limited  to  white  noise  input  and 


27 


orthonormal  approximating  functions  in  order  to  illustrate  the  theory  involved 
and  to  carry  this  theory  through  a  practical  development.     It  is  believed  that  the 
results  justify  further  efforts  along  this  line. 
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